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C^ , Under the hypothesis that an initial point is a quasi-regular point, we use a majorant 

condition to present a new semi- local convergence analysis of an extension of the Gauss- 
Newton method for solving convex composite optimization problems. In this analysis 
the conditions and proof of convergence are simplified by using a simple majorant 

K*" ' condition to define regions where a Gauss-Newton sequence is "well behaved". 
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1 Introduction 

Consider the convex composite optimation problem 

min h(F(x)), 

x: 

^ . where h : M™ — )■ M is a real-valued convex and F : M" -t- M*" is continuously differentiable. 

As it is well known, see [H [TJ |8] and references therein, a wide variety of applications with this 
formulation can be found in mathematical programming literature, e.g., nonlinear inclusions, 
penalization methods, minimax, and goal programming. Besides its practical applications. 
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this model provides a convenient tool for the study of first and second order optimality 
conditions in constrained optimization. 

The basic algorithm considered in [H [3, [8] , which is an extension of the Gauss-Newton 
method for solving nonlinear least square problem, will be considered in this paper. The 
study of (lH) is related to the convex inclusion problem 

F{x) eC:={zeW: h{z) < h{x), x G W}, (2) 

because if x* G M" satisfies the convex inclusion ([2]) then x^, is a solution of ([T]), but if 
x^, G M" is a solution of ([1]) it does not necessarily satisfy the inclusion convex (|2]). Although 
a priori, our goal is to give criteria that ensure the convergence of the sequence generated 
by the Gauss- Newton algorithm for a solution of ([1]), we will give a criteria that ensure the 
convergence of that sequence for some x* G M" satisfying -F(x*) G C which, in particular, 
solves (P). 

In this paper, we are interested in the semi- local convergence analysis, i.e., based on 
the information at an initial point, criteria are given that ensure the convergence of the 
sequence generated by the Gauss-Newton algorithm for some x* G M" with -F(x^,) G C. 
Under the hypothesis that the initial point is a quasi-regular point of the inclusion (|2]), 
we use a majorant condition similar to the one used in [21 HI E] to present a new semi- 
local convergence analysis for the sequence generated by the Gauss-Newton algorithm. The 
convergence analysis presented here communicates the conditions and proof in quite a simple 
manner. This is possible thanks to our majorant condition and a demonstration techinique 
in which instead of only looking to the generated sequence, we identify regions where the 
Gauss-Newton sequence (for the convex composite optimation problem) is well behaved, as 
compared with Newton method applied to an auxiliary function associated with the majorant 
function. This technique was introduced in [4]. 

The convergence of the sequence generated by the Gauss-Newton algorithm was also 
studied in lU [71 18]. Among these, the criterion introduced by Li and Ng in [7] is the best. 
Besides the technique used in the demonstration, the main difference from our analysis 
regarding [7] is that they used Wang's condition, introduced in [13], in place of our majorant 
condition. But, the formulation using the majorant condition provides a clear relationship 
between the majorant function and the nonlinear function F under consideration. Besides 
this, the majorant condition simplifies the proof of convergence. 

The organization of our paper is as follows. In section II. ![ we list some notation and 
one basic result. The Gauss-Newton algorithm is discussed in Section |21 in Section I2TT] we 
present some regularity properties, and an analysis of the majorant and auxiliary functions 
is established in Section 12.21 In Section |3] the main result is stated and in Section 13.11 it is 
proved. Some applications of this result are given in Section |H 



1.1 Notation and auxiliary result 

The following notation and result are used throughout our presentation. Let M" be with 
a norm || ■ ||. The open and closed ball in M" with center x and radius r are denoted, 
respectively by B{x,r) and -B[x,r]. The polar of a closed convex W C M" is the set W° := 
{2; G M" : {z,w) < 0,Vu7 G W}. The distance from a point x to a set W G M" is given by 
d{x, W) := inf{||x - w;|| -.we W}. The set of all subsets of M" is denoted by P(]R") and 
Ker{A) represents the kernel of the linear map A. Finally, the sum of a point x G M" with 
a set X G P(M") is the set given hy y + X = {y + x : x e X}. 

The following auxiliary result of elementary convex analysis will be needed: 

Proposition 1. Let I G M. be an interval, and if : I -^ M. be convex. If u,v,w G I , u < w, 
and u < V < w then 

ip{v) - <f{u) < [<f{w) - <f{u)] . 

w — u 

Proof. See Theorem 4.1.1 on p. 21 of [S]. D 

2 Preliminary 

In this section we present the algorithm to solve problem ([1]), a brief study of regularity, 
and an analysis of our majorant and auxiliary functions. The results of this section are the 
main tools used in the proof of convergence of the sequence generated by the Gauss- Newton 
algorithm. 

In order to state the Gauss- Newton algorithm, for solving problem ([ID, we need the 
following definition: For A G (0, +00) and x G M" define 

Da{x) := argmin {h{F{x) + F\x)d) : deM."^, \\d\\ < A} , (3) 

that is, D^{x) is the solution set for the following problem 

min {h{F{x) + F'{x)d) ■.deM.'', \\d\\ < A} . (4) 

Given that A G (0, +00], rj G [1, +00) and a point xq G M", the Gauss-Newton type algorithm 
associated with (A,r7,xo) as defined in pj (see also, [3 [8]) is as follows: 

Algorithm 1. 

Initialization. Take A g (0, +00], rj e [1, +00) and xq g M". Set k = 0. 
Stop criterion. Compute D^{xk). IfOe D^{xk), STOP. Otherwise. 
Iterative Step. Compute dk satisfying 

dk e D^ixk), \\dk\\ < r]d{0,DA{xk)), 



and set 

Xk+i = Xk + dk, 

k = k + I and GO TO Stop criterion. 

Note that, since (jl]) is a convex optimization problem in a compact set, it follows that 
the set D^{x) is nonempty, for all x G M". Therefore, the sequence {xk} generated by 
Algorithm [1] is well defined. 

2.1 Regularity 

In this section we state the hypothesis on the starting point of the sequence generated by 
Algorithm [H which we need in our analysis, as well as some related concepts. 

Let C be as defined in ([2]), that is, C is the set of all minimum points of h. For each 
X G M", we define the set Dc{x) associated to C as 

Dc{x) := {rf G M" : F{x) + F'{x)d G C}. 

In the next proposition we state a relation between the sets Da{x) and Dc{x). 

Proposition 2. Let x G M". If Dc{x) ^ and d{0,Dc{x)) < A, then 

D^{x) = {de M" : \\d\\ < A, F{x) + F\x)d e C} C Dc{x). 

As a consequence, d{0,DA{x)) = d{0,Dc{x)). 

Proof. By definition of C in ([2]) and D^{x) in ([3]) it can be seen that 

{d G R" : ||ci|| < A, F{x) + F\x)d G C} C D^{x). 

Let d G Di^{x). Since Dc{x) ^ and d{0,Dc{x)) < A, there exists d G Dc{x) such that 
||J|| < A and F{x) + F'{x)d G C. Hence, from the definition oi C in (^ and Da{x) in (^ 
we obtain d G D^{x). Therefore, as J, d G D^{x), and using again the definition of D/^{x) 
in ([3]), we have 

h{F{x) + F\x)d) = h{F{x) + F\x)d). 

Now, using F{x) + F\x)d G C, the last equality and definition of C, we obtain F{x) + 
F'{x)d G C, which proves the first statement. The second statement, i.e., D^{x) C Dc{x) 
can be seen by definition of Dc{x). To conclude the proof, first note that the inclusion 
Da{x) C Dc{x) implies that 

d{<d,D^{x))>d{<d,Dc{x)). (5) 



Since Dc{x) 7^ and d{0, Dc{x)) < A, there exists d G Dc{x) such that 

||d|| =d{0,Dcix)) < A. 
Hence, from definition of C in (|2]) and D^{x) in ([3]) we conclude that d G D/^{x). Therefore, 

d{0,D^{x))< \\d\\=d{0,Dc{x)) 
and taking into account ([5]), the proof is concluded. D 

Definition 1. Let F : M" — )■ M™ be a continuously differentiable function and let h : M'" — )■ M 
6e a real-valued convex function. A point xq G M" zs called a quasi-regular point of the 
inclusion ([2]), that is, of the inclusion 

F{x) eC:={zeR'^: h{z) < h{x), X G M™}, 

if r E (0, +00) exists as well as an increasing positive-valued function (3 : [0, r) — > (0, +00) 
such that 

Dc{x) ^ 0, rf(0, Dc(a;)) < /3(||a; - xo||)rf(F(x), C), Vx G ^(xo, r). (6) 

Let xo G M" be a quasi-regular point of the inclusion ([2]). We denote r^^ the supremum 
of r such that ([6]) holds for some increasing positive- valued function /3 on [0, r), that is, 

Ta-Q := sup {r : 3/3 : [0,r) — )■ (0, +00) satisfying ([6])} . (7) 

Let r G [0,r^.Q). The set i3r(xo) denotes the set of all increasing positive- valued functions /3 
on [0, r) such that (jHl) holds, that is, 

i3,(xo) := {/3 : [0,r) ^ (0, +00) : /3 satisfying (0)} . 

Define 

/3,,(t) := inf {/3(t) : /3 G S.,„(xo)} , t G [0,r,.J. (8) 

The number r^^ and the function /3j;q are called, respectively, the quasi-regular radius and 
the quasi-regular bound function of the quasi-regular point xq. 

Remark 1. Note that from the definition ofr^^ and Pxo ^^ ^s ^C'Sy to prove that for allr < r^g 
such that limt^r- P{t) < +c>o it holds that 

(3x,{t) = inf {/3(t) : (3 G i3,(xo)}, t G [0,r). 



2.2 The majorant condition 

In this section, we define the majorant condition for the nonhnear function F, which relaxes 
the assumption of Lipschitz continuity to F', used in our analysis. We present an analysis of 
the behavior of the majorant function and of a certain associated auxiliary function - more 
details about the majorant condition can be found in [21 IH [S]- 

Definition 2. Let R > 0, xq E W^ and F : M" — )• M™ be continuously differentiable. A 
twice-differentiable function f : [0, i?) — t- M zs a majorant function for the function F on 
B{xq,R) if it satisfies 

\\F\y) - F\x)\\ < f\\\y - x|| + ||x - Xo||) - f\\\x - x,\\), (9) 

for any x,y E B{xo, R), \\x — Xo|| + \\y — x\\ < R, and moreover, 

hi) /(O) = 0, /'(O) = -1; 

h2) /' is convex and strictly increasing. 

In the next result we bound the linearization error of the function F by the error in the 
linearization on the majorant function. 

Lemma 3. Take 

x,y E B{xo, R) and <t < v < R. 

If \\x — XqII ^ t and \\y — x\\ ^ v — t, then 



\Fiy) - [Fix) + F\x){y - x)\\ ^ f{v) - [f(t) + f'(t){v - t)] 



\y-x\ 



v-t 
Proof. The proof follows the same pattern as Lemma 7 from [5]. D 

To state our main theorem we need a certain auxiliary function associated with the 
majorant function. We shall see later that the sequence generated by Algorithm [1] will be 
"majorized " by the Newton sequence associated with this auxiliary function. 

Let / : [0, i?) — 7- M be a majorant function for the function F on B[xo, R). Take ^ > 0, 
a > and define the auxiliary function 

t ^ ^+{a-l)t + afit). ^ ^ 

Now, consider the following conditions on the auxiliary function /^ „: 



h3) there exists t^, G (0, i?) such that f^,a{t) > for all t G (0,t*) and f^^a{t^) = 0; 

h4) fl^JQ < 0. 

From now on, we assume that / : [0, i?) — t- M is a majorant function for the function F 
on B{xo, R) and that h3 holds. The assumption h4 will be considered to hold only when 
explicitly stated. 

Proposition 4. The following statements hold: 

i) 4a(0)=e>0, /^,„(0) = -l; 

ii) ft ^ is convex and strictly increasing. 

Proof. Seen from the definition in (ITOl) and assumptions hi and h2. D 

Proposition 5. The function f^^^ is strictly convex, and 

4aW>o, 4Jt)<o, t < t - 4,(t)/4Jt) < t„ vtG[o,t,). (11) 

Moreover, f^^^i'^*) < 0. 

Proof. Using Proposition HI the proof follows the same pattern as Proposition 3 from [5]. D 



In view of the second inequality in (jTTl) . the Newton iteration map is well defined in 
[0, t*). Let us call it 

t ^ t-fat)/fut)- ^''' 

Proposition 6. For each t G [0,t*) it holds that ^ < nj^^it). 

Proof. Proposition implies that /^_q, is convex. Hence, using the first item of Proposition H] 
it is easy to see, by using convexity properties, that t — ^> ~f^,a{t). So, the above definition 
implies that 

Proposition m implies that ff^i^) = —1 and f^^ is strictly increasing. Thus, we obtain 
ffai^) + 1^0) for all t G [0,t^,). Therefore, combining the above inequality with the first 
two inequalities in Proposition |5] the desired result follows. D 



Proposition 7. Newton iteration map Uf^^ maps [0,t*) in [0,t*), and it holds that 

t < nj^Jt), t, - nj^Jt) <: i(t, - t), Vt G [0, t,). 

If f(,a O'lso satisfies h4, i.e., /^^Q,(t*) < 0, then 

Proof. The proof follows the same pattern as Proposition 4 of [5] . D 

The Newton sequence {t^} for solving the equation /g,a(t) = with starting point to = 
is defined as 

to = 0, tfc+i = n/^^(tfc), fc = 0,l,.... (13) 

Therefore, by also using Proposition [7] it is easy to prove that 

Corollary 8. The sequence {t^} is well defined, is strictly increasing, is contained in [0,t^), 
and converges Q-linearly to t* as follows 

t* — tfe+i < -(t* — tjt), k = 0,1, . . . . 

If fi,a also satisfies assumption h4, then {t^} converges Q-quadratically to t* as follows 

t* — tfc+i < „, , , (t» — tjt) , /c = 0, 1, . . . . 

Proposition 9. The map [0,t*) 9 t — )■ —f^,a(t)/ffai^) ^■^ decreasing. 

Proof. Proposition [5] implies that /^a(^) 7^ ^^ ^11 ^ ^ [0,t*). So, the function in the 
proposition is well defined. As /^ q is twice-differentiable we have 



fijt) / (JiJt)? 



Hence, it suffices to show that 



fUt)flait) - UUt)f < 0, ^te [o,t,). (14) 



Since /^^q, is strictly convex (Proposition |5]) and //^ is convex (Proposition H]), we have 

o>fUt) + fiamt*-t), flait)>0, fUQ>fUt) + fl^it)iu~t), yte[0,Q. 

Using these inequahties and the second inequahty in (fTTl) . we obtain 

fat)fiait) - if'at))' < ram - Qrut) - {fat)r < -fat)faQ. 

which combined with Proposition [5] yields the inequality in flT^ . Therefore, the proposition 
is fulfilled. D 

Proposition 10. It holds that C, < t^,. Moreover, if 

«> , Jfr,flii^r ve<^<^*' (15) 

vPxo{tj[f'{t) + l] + l 
then 

Proof. Proposition [5] implies that f^^a is strictly convex, which combined with the definition 
of t* in h3 and item i of Proposition H] gives 

= fUQ > kM + fiaim* - 0) = e - 1*, 

which proves the first statement. 

Combining the assumption in flT^ . as well as hi and h2, we obtain after simple calculus 

that 

ar//3,„(t)(/'(t) + 1) + a > vMt), V ^ < t < t.. 

Hence, using /^Q,(t) = (« — 1) + af'(t) and some algebraic manipulations, the last inequality 
becomes 

which combined with the second inequality in (fTTl) yields the desired inequality. D 

Proposition 11. Let < a < a for the corresponding auxiliary functions f^,oi o,nd f^^a, os 
well as t* and t*, its smallest zeros, respectively. Then the following assertions hold: 

i) f(,a < f(,a on {0,R); 
ii) fi^<fiaOn{0,R); 
iii) i^ < t^. 



Proof. From h2 it follows that /' is strictly increasing which implies that / is strictly convex. 
Thus, using hi we conclude that f(t) + 1 > 0, for all t G (0,-R) and hence the assumption 
a > a implies 

«(t + /(t))<«(t + /(t)), yte[0,R). 

To conclude the proof of item i, add ^ — t on both sides of the last inequality and use the 
definition in flTOj) . 

To prove item ii, we first use that /' is strictly increasing (h2), as well as the assumption 
a > a to obtain that (a — a)(/'(t) — /'(O)) > 0, for all t G (0, R). Hence, from hi and some 
algebraic manipulation, we obtain 

(a - 1) + a fit) <(«-!) + af'{t), V t G [0, i?). 



So, by using the definition in (jTOl) . the statement holds true. 

To establish item iii, use item i and the definition of t* and t* in h3. D 

3 Semi-local analysis for the Gauss-Newton method 

In this section our goal is to state and prove a semi-local theorem for the sequence generated 
by Algorithm [1] in order to solve problem ([1]). Under the hypothesis that the initial point is 
a quasi-regular point of the inclusion ([2]) and the nonlinear function F satisfies the majorant 
condition in Definition O we will prove convergence of the sequence to a point x^, G B[xo, t*] 
such that F{x^) G C, and in particular that x* solves ([T]). The statement of the theorem is: 

Theorem 12. Let F : M" — t- M"^ be a continuously differentiable function. Assume that 
R > 0, Xq E M"' and / : [0, R) ^ M is a majorant function for F on B{xo,R). Take the 
constants a > and C, > and consider the auxiliary function f^^a '■ [0, R) — )■ M, 

4aW:=e + («-l)t + «/(t). 

U f\,a satisfies h3, i.e., t* is the smallest zero of f^^^, then the sequence generated by Newton's 
method for solving /g,a(t) = 0, with starting point to = 0, 

tk+i = tk-fia{tkr'f^Atk), A: = 0,1,..., (16) 

is well defined, {tk} is strictly increasing, is contained in [0,t,,), and converges Q-linearly to 
t*. Let rj G [1, oo), A G (0, cxd] and h : M."^ -^ M. a real-valued convex function with minimizer 
set C nonempty. Suppose that xq G M*^ is a quasi-regular point of the inclusion 

F{x) G C, 
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with the quasi-regular radius r^^ and the quasi-regular bound function Px^ as defined in ([7]) 
and OH]), respectively. If d{F{xo),C) > 0, t* < r^g, 

A>«>,&.(OMFM.C). ''>^^p{ ^^^^^,^f/;;^l,^^, :(<t<t.]. (17) 

then the sequence generated by Algorithm [1], denoted by {xk}, is contained in B{xQ,t^,), 

F{xk) + F\xk){xk+i-Xk)eC, A; = 0,1,..., (18) 

satisfies the inequalities 

II W ^ + 4- II II ^ '■fe+l tk II ||2 /^ (^N 

\\Xk+l — Xk\\ ^ T^k+l — tk, \\Xk+l — Xk\\ S — ^W^k — Xk-l\\ , [i-i)) 

[tk — tfc-lj 

k = 0,1, . . . , and k = 1,2,..., respectively, converge to a point x* G B[xo,t^] such that 
F{x,) e C, 

\\x^ — Xk\\ <t^ — tk, fc = 0, 1, . . . (20) 

and the convergence is R-linear. If, additionally, f^^^ satisfies h4 then the sequences {tk} 
and {xk} converge Q-quadratically and R-quadratically to t^, and x*, respectively. 



Remark 2. //, 



">^^='"P^.,&W/W + i] + i^^-'^*-^' 



then the sequence {xk} converges R-quadratically to x*. To prove this assertion, note that 
through item iii of Proposition [771 we have t* < t*. Hence, using that fl^ strictly increasing 
and item ii of Proposition \TT\ we obtain 

fUQ < fUQ < fiaiQ, 

which, combined with Proposition\^ implies that f^^i'^*) < 0. So, the statement is correct if 
f^^a is replaced by f^^a in Theorem [7B 

Remember that aU statements made in Theorem [12] for the sequence tk were proven in 
Corollary [8] 

From now on, we assume that the hypotheses of Theorem [12] hold, with the exception of 
h4, which will be considered to hold only when explicitly stated. 
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3.1 Proof of convergence 

In this section we prove convergence of the sequence {xk} generated by Algorithm [T]for 
solving ([1]), based on the assumptions stated in Theorem [T2l 

As we saw in Section [21 D/^{x) ^ for all x G M", therefore the sequence {xk} is well 
defined. But this is not enough to prove the convergence of sequence {x^} to some point 
X* e M" such that F(x*) G C, because we have no relationship between the set of search 
directions D/:^{x) to the set of solutions of the hnearized inclusion 

F{x) + F\x)d&C, IM||<A. 

Now, if we prove that D/^^{x) C Dc{x) for suitable points, then we can use the results of 
regularity to relate the sets mentioned above. First, we define some subsets of B{xo,t^) in 
which, as we shall prove, the desired inclusion holds for all points in these subsets. 

Kit):=lxEW' : \\x - Xo\\ < t, r]diO, Dc{x)) ^ -^^^/^l , t e [0,Q , (21) 

K:= [j Kit). (22) 

tG[0,t,) 

In (pT!) we assume that ^ t < t*, therefore it follows from Proposition |5] that f'c^{t) 7^ 0. 
So, the above definitions are consistent. 

Proposition 13. IfxEK, then 

Da{x) = {deW : F{x) + F\x)d G C, \\d\\ < A} C Dc{x), 

and 

d{0,DAix)) = diO,Dcix)). 

Proof. From Proposition [2] it is sufficient to prove that Dc{x) 7^ and d{0,Dc{x)) < A for 
all X E K. Let x E K., then x G K{t) for some t G [0,t*) which implies that x G B{xQ,t^). 
Since t^, < r^.^ and Xq is a quasi-regular point, it follows from Definition [1] and the definition 
of the quasi-regular radius in ([7]) that Dc{x) 7^ 0. 

By hypothesis 77 > 1 and ^ ^ A. Thus, as a; G K{t), by using the definition in fl?I]) . 
Proposition [9l and Proposition H] we obtain 

rf(0, Dc{x)) ^ vd{0, Dc{x)) ^ -^ ^ -^ = e ^ A, 

which proves the desired result. D 
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For each x G M", we define the set D^{x) as 

D^{x):={deD^{x) : \\d\\ < r]d{0 , D a{x))} . (23) 

As Da{x) 7^ for all x G M", we have Da{x) ^ for all x G M" and consequently, the 
Gauss-Newton iteration multifunction is well defined. Let us call Gp the Gauss-Newton 
iteration multifunction for F in B{xQ^t^): 

Gf:B{xo,U) ^ P{Rn ,24) 

X H- X + Da{x). 

We shall prove that the Gauss-Newton iteration multifunction is "well behaved" on the 
subsets defined in (1?T]) . but first we need the following technical result: 

Lemma 14. For each t G [0,t*), x G K{t) and y G Gpix) it holds that: 

i) \\y-x\\ <nf^^{t) -t; 

ii) ||y-xo|| < n/^,,(t) < t*; 



iii) r]d{0,Dc{y))< 



f^A^hA^)) f \\y-x\ 



fU^hJt)) \nf^Jt)-t 



Proof. Since t G [0,t*) and x G -ft'(t), by using the definition in f l2ip . Proposition [T^ and the 
first two statements in Proposition [71 we obtain 

\\x-Xo\\<t, j^d{0,DAix))=r]diO,Dcix))^-^)^, t<nf^Jt)<t,. (25) 

Now, as 1/ G Gf{x) there exists li G Da{x) such that y = x + d. Using the definition of the 
set Da{x) in ( l23l) and the second inequality in ( l25l) it follows that 

\\d\\ < vdiO,DA{x)) = vdiO,Dc{x)) < -^^(t)/^ Jt). 

Since d = y — x, the last inequality together with the definition in ( TT2l) implies item i. 

Triangular inequality combined with the first inequality in (l25l) . item i, and the last 
inequality in (125!) yields 

\\y - a^oll < \\y - x\\ + ||x - xoll < n/^,„(t) < t^, (26) 

which proves item ii. 
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Since \\y — xq\\ < t* and t* < r^^ we obtain by the quasi regularity assumption 

Dc{y) + 0, rf(0,Dc(2/)) < /3.o(|b-a;o||)rf(F(y),C). 

As X G -ft'(t) C K and y — x = d E D^^x), it follows from Proposition [T3] that 

F{x) + F'{x){y-x) eC. 

Therefore, taking into account that ^ > 1, by using the above inequality and the last inclusion 
it is easy to conclude that 

77(i(0, Dc{y)) < r//3.o(||y - xM\F{y) - Fix) - F'{x){y - x)\\. 

On the other hand, from item i we have ||y — x|| < nj ^{t) —t and, as ||a; — Xq || < t, by using 
Lemma [3] we have 

\\F{y) - F{x) - F\x){y - x)\\ < [/^ Jt)) - f{t) - f\t){nj,^t) - t)] [Jf^^^j ■ 
Hence, combining the two above inequalities we conclude that 

77^(0, Dc{y)) < vP^oiWy - ^o||)[/K,Jt)) - fit) - rmuf^Jt) - 1)] ( "^~f'' ) ' . (27) 
Now, the definition in (IT2l) implies that f^,a(t) + f^ai^)i^fi;ai^) —t)=0. So, we have 



By using the definition in (jTOl) and after simple algebraic manipulation, the last equality 
becomes 

fU^fU^)) = " (/K. W) - /(^) - /'W(^/,,. W - 1)) . 

So, as /Sa-Q is an increasing function, by a simple combination of (!26|) . fl2711 and the last 
equality, we obtain 

Vt^xoinj^Jt)) ^ ^ ^^^^ f \\y-x\ 



vd{0,Dc{y)) < "^'" ''^"' " fUnf.Jt)) 



From Proposition [6] and the first statement in Proposition [7] we have ^ < nf^^{t) < t^,. Thus, 
by using the last inequality and Proposition [TOl the last inequality of the lemma follows. D 
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In the next result we prove the desired result, namely, that the Gauss-Newton iteration 
multifunction is "well behaved" on the subsets defined in fl2T]) . 

Lemma 15. For each t G [0,t*), the following inclusions hold: K{t) C B{xo,t^) and 

GFiKit))cK{nf^Jt)). 
As a consequence, K C B{xQ,t^,) and Gf{K) C K. 

Proof. The first inclusion follows trivially from the definition of K{t). Take x G K{t) and 
y G Gp {x) ■ Combining items i and iii of Lemma [H] we have 

7]d{0,Dc{y)) < - ■ 

The last inequality together with item ii of Lemma [H] and the definition in (12T!) show us 
that y G K{nf^^{t)), which proves the second inclusion. 

The next inclusion, first on the second sentence, follows trivially from definitions (12T!) 
and (12^ . To verify the last inclusion, take x E K. Therefore, x G K(t) for some t G [0,t*). 
Using the first part of the lemma, we conclude that Gf{x) C K{nf^^{t)). To end the proof, 
note that Uf^^it) G [0,t*) and use the definition of K. D 

Finally, we are ready to prove the main result of this section which is an immediate 
consequence of the latter results. First, note that definitions ( l23l) and (12^ imply that the 
sequence {xk} satisfies 

Xk+ieGpixk), /c = 0,l,..., (28) 

which is indeed an equivalent definition of this sequence. 

Corollary 16. The sequence {xk} which is contained in i?(xo,t*), converges to a point 
x^ G B[xQ,t^] such that F{x^) G C. Moreover, {xk} and {tk} satisfy (TT8|) . (TT9|) and (!20|) . 
Furthermore, if f^^a o-lso satisfies assumption h4 then {xk} converges R-quadratically to x^,. 

Proof. Since Xq G B{xQ,t^) C B^XQ^r^o)] by using the quasi regularity assumption, r^ > 1, 
the first inequality in (fT7|) . and Proposition HI we obtain 

Dc{xo) ^ 0, r7rf(0, Dc{xo)) < r//3,o(0)rf(F(xo), C) < ^ = -|4^. 

Therefore, 

xo G K{0) C K, 
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where the second inclusion follows trivially from fl22|) . Using the above inclusion, the in- 
clusions Gf{K) C K (Lemma [T5l) and fl28l) . we conclude that the sequence {xk} rests in 
K and, in particular, we have {x^} contained in B{xQ,t^). Since {x^} C -ft', by combining 
Proposition [T3] and Algorithm [H the inclusion in ( IT8l) follows. Now, we prove by induction 
that 

XkeKitk), A; = 0,1,.... (29) 

The above inclusion, for A; = 0, is the first result in this proof. Assume that Xk G K{tk). From 
( TT3i) we have t^+i = rif^^itk) and, as Xk € K(tk), Lemma fT5l implies that Gpixk) C K(tk+i), 
which taking into account ( l28l) completes the induction proof. 

Simple combination of Algorithm [1] with (!29|) . Proposition [T3| and ( pT]) yields 

||xfc+i - Xfcll < r/ci(0, DA(a:fc)) = r/ci(0, /^c(a;fc)) ^ -^1454' A; = 0, 1, ... , (30) 



which, using ( 1161) becomes 

||a^fc+i — Xk\\ < tfc+i ~ ^fc, /c = 0, 1, . . . . 

So, the first inequality in ( 1T9l) holds. On the other hand, as {tk} converges to t*, the above 
inequalities imply that 

oo oo 

y^ ||a;fc+i - Xk\\ < ^ tfc+i -tk = U- tko < +00, 

k=ko k=ko 

for any /cq G N. Hence, {xk} is a Cauchy sequence in i?(xo,t*) and so converges to some 
X* G -B[xo,t*]. Moreover, the above inequality also implies ( 120|) . i.e., ||a;* — Xfc|| < t,. — t^, for 
any k. As C is closed, {xk} converges to x*, 

F{xk) + F'{xk)ixk+i - Xk) e C, 

and F is a continuously differentiable function; therefore, we have -F(x*) G C. 

In order to prove the second inequality in ( [T9l) . first note that x^ G K{tk) and tfc+i = 
nf^^{tk), for all fc = 0, 1, . . . . Thus, take an arbitrary A; and apply item iii of Lemma UM with 
y = Xk, X = Xk~i and t = tk-i to obtain 

?7(i(0,L'c(a;fc)) < 



fiai^k) \ tk — tk-1 

which, using (fT6|) and the first inequality in ( |30|) yields the desired inequality. 

To end the proof, combine (1201) with the last inequality in Corollary |SJ D 

Therefore, it follows from Corollaries M and [16] that all statements in Theorem [12] are 
valid. 
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4 Special cases 

In this section, we present special cases for Theorem [121 They include the case where xq is 
a regular point of the inclusion ([2]), and the case where xo satisfies the Robinson condition. 
Moreover, we present the result of convergence under the Lipschitz and Smale conditions. 

4.1 Convergence result for regular starting point 

In this section we present a correspondent theorem to Theorem [121 namely, we assume that 
Xo is a regular point of the inclusion (El), see [1] and references therein. We also present results 
of convergence under the Lipschitz and Smale condition. We start by defining regularity. 

Definition 3. Let F :W"' ^ M™" be a continuously differentiable function and let h : M™ — ;■ M 
be a real-valued convex function with minimizer set C nonempty. A point Xq ^MT' is a regular 
point of the inclusion F{x) & C if 

Ker{F\x,Y) n{C- F{x,)r = {0}, 

As we know (see (T]) the definition of a quasi-regular point extends the definition of a 
regular point. The following proposition relates these two concepts, where the existence of 
constants r and /3 is due to Burke and Ferris in |lj, and the second assertion then follows 
from Remark [H 

Proposition 17. Let Xq & W^ be a regular point of the inclusion F{x) G C . Then there 
exist constants r > and /3 > such that 

Dc{x) ^ e rf(0, Dc{x)) < (3d{F{x), C), Vx G 5(xo, r). 

Consequently, xq is a quasi-regular point with the quasi-regular radius r^^ > r and the quasi- 
regular bound function /5xo(") < (3 on [0,r), as defined in l^^ and (El), respectively. 

From now on, for each regular point xq G M" of the inclusion F{x) G C we will denote 
by r > and ^ > 0, the associated constants given by the last proposition. 

Theorem 18. Let F : M" — ;■ M"* be a continuously differentiable function. Assume that 
i? > 0, Xo G M" and / : [0, i?) — )■ M zs a majorant function for F on B{xo,R). Take the 
constants a > and ^ > and consider the auxiliary function f^^a '■ [0, -R) — )■ M, 

fUt)=C+{a-l)t + af{t). 
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If) fi,a satisfies h3, i.e., t* is the smallest zero of f^^a, then the sequence generated by 
Newton's Method for solving f^,a{t) = 0, with starting point tg = 0, 

tk+l = tk — f^^ai'tk) f(,a{tk), k = 0,l,..., 

is well defined, {tk} is strictly increasing, is contained in [0,t*), and converges Q-linearly 
to t*. Let rj G [l,c>o), A e (0, oo] and h : M"^ —> R be a real-valued convex function with 
minimizer set C nonempty. Suppose that xq ^W" is a regular point of the inclusion F{x) G C 
with associated constants r > and (3 > 0. If d{F{xo), C) > 0, t^ < r, 

A > e > vmFixo), C), a> vP/ivPif'iO + 1] + 1), 

then the sequence generated by Algorithm [T], denoted by {xk}, is contained in B{xQ,t^), 

F{xk) + F'{xk){xk+i -Xk) eC, /c = 0, 1, . . . , 

satisfies the inequalities 

II II ^ + + II II ^ ^fc+l ~ ik II ,|2 

[tk — tk-l) 

for k = 0,1, . . . , and k = 1,2, . . . , respectively, converging to a point x^ G B[x(), t^,] such that 

F{x,) e C, 

llx* x^ll ^ t* tk, fc ^ U, i, . . . 

and the convergence is R-linear. If, additionally, /^.q, satisfies h4 then the sequences {tk} 
and {xk} converge Q-quadratically and R-quadratically to t* and x^, respectively. 

Proof. Since xq is a regular point for the inclusion, we have from Proposition [17] that xq is 
a quasi-regular point for the inclusion F{x) G C with the quasi-regular radius r^^ > r. So, 
taking into account the assumption t^, < r we obtain 

Moreover, Proposition [T7] also implies that the quasi-regular bound function 

/3.oW</3, Vt G[0,r). (31) 

Since A > ,^ > ri(3d{F{xo), C) and the last inequality implies that (3xo{^) ^ Z^, we have 

A>^>r]l3xMd{F{xo),C). 



Now, combining the assumptions < ^ and t^ < r with the first statement in Proposition [TO] 
we conclude that < ,^ < t^, < r. So, using f l3T]) . /'(O) = —1, /' as strictly increasing and 
1] > 1] after simple algebraic manipulation we obtain 



r//3[/'(0 + 1] + 1 - r7/3.oW[/' W + 1] + 1' 
Hence, the assumption a > ri(3/{rif3[f'{^) + 1] + 1) and the last inequality imply that 

a > sup I--— !^M^1— : e < t < t, 

Therefore, F and xq satisfy all assumptions in Theorem [12] and consequently the statements 
of the theorem are satisfied. D 

Under the Lipschitz condition. Theorem [18] becomes: 

Theorem 19. Let F : M" — )■ R"* be a continuously differentiable function. Assume that 
Xq e R", R> and K > 0, such that 

\\F'{y)-F\x)\\<K\\y-x\\, x,y eB{xo,R). 

Take the constants a > and ^ > and consider the auxiliary function f^^^ '■ [0, -R) — t- R, 

4aW = e-t + («irt2)/2. 



If 2aK^ < 1, then t^ = {1 — -\/l — 2aKS,)/{oiK) is the smallest zero of f^a, the sequence 
generated by Newton's Method for solving /g,a(t) = 0, with starting point to = 0, 

tk+l = tk — f^^ai'tk) f(,a{tk), k = 0,l,..., 

is well defined, {tk} is strictly increasing, is contained in [0,t*), and converges Q-linearly 
to t^. Let Tj G [l,C)o), A e (0, oo] and h : R*" — > R 6e a real-valued convex function with 
minimizer set C nonempty. Suppose thatxo G R" is a regular point of the inclusion F{x) G C 
with associated constants r > and (3 > 0. If d{F{xo),C) > 0, t* < r, 

A > e > 7^(3d{F{xo),C), a > r]f3/{Kr]f3^ + 1), 

then the sequence generated by Algorithm [TJ denoted by {xk}, is contained in i?(a;o,t*), 

F{xk) + F'{xk){xk+i -Xk)eC, fc = 0, 1, . . . , 
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satisfies the inequalities 

\\xk+i ~ Xk\\ < tk+i — tk, 



I II ^ ^fc+l ~ tk II ||2 

l-'^fc+l '''fell _ TT 7 Toll '^ •''fe— ill 5 

[tk — tk-l) 



for k = 0,1, . . . , and k = 1,2, . . . , respectively, converging to a point x^ G B[x(), t^,] such that 

F{x,) e C, 

and the convergence is R-linear. If, additionally, 2aKC, < 1 then the sequences {tk} and 
{xk} converge Q-quadratically and R-quadratically to t* and a;*, respectively. 

Proof. It is promptly proved that / : [0, i?) — ;■ R defined by f{t) = Kt'^/2 — t is a niajorant 
function for the function F on B{xo, R). Hence, 

fUt) =^-t+ {aKt^)/2 = ^ + {a-l)t + af{t). 



and, since 2aK^ < 1, we conclude that f^^a satisfies h3 and t* = (1 — a/1 — 2aK^ )/{aK) is 
its smallest root. In this case, the constant a satisfies 



a > 



VP 



r//3 



1 + Kr]f3^ r^f3[f'{^) + 1] + 1- 



Therefore, taking a, f^^a and t^, as defined above, all the statements of the first part of the 
theorem follow from Theorem [T8l For proving the second part, it is sufficient to note that 
the assumption 2aKC, < 1 implies that /^ ^ satisfies h4. D 

Under the Smale condition, see [12], Theorem [TSl becomes: 

be an analytic function. Assume that xq G M" and 



7 := sup 

n>l 



ni 



< +00. 



(32) 



Take the constants a > and ^ > and consider the auxiliary function f^^a '■ [0, 1/7) — )■ M, 



"^/-t+e 



l-7t 



If^l <l + 2a- 2^a{l + a) then 



2(l + a)7 
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is the smallest zero of f^^, the sequence generated by Newton's Method for solving f^,a{t) = 0, 
with starting point to = 0, 

tk+l = tk — f^^ai'tk) f(,a(tk), k = 0,l,..., 

is well defined, {tk} is strictly increasing, is contained in [0,^*), and converges Q-linearly 
to t*. Let 7] G [l,oo), A G (0, oo] and h : M*" — > M 6e a real-valued convex function with 
minimizer set C nonempty. Suppose thatxo G R" is a regular point of the inclusion F [x) G C 
with associated constants r > and /3 > 0. If d{F{xQ),C) > 0, t* < r, 

A>^>r^(3d{F{xo),C), a> "^^(^ ' ^0' 



r7/3 + (l-r7/3)(l-70'' 
then the sequence generated by Algorithm [1], denoted by {xk}, is contained in B{xo,t^), 

F{xk) + F'{xk){xk+i -Xk) eC, fc = 0, 1, . . . , 

satisfies the inequalities 

II II II II tf^-^i — tk II II 2 

\\Xk+l - Xk\\ < tk+l - tk, \\Xk+l - Xk\\ < — -^||Xfc - Xk-l\\ , 

[tk — ifc-ij 

for k = 0,1, . . . , and k = 1,2, . . . , respectively, converging to a point x^ G B[xo, t^] such that 
F{x,) G C, 



and the convergence is R-linear. If, additionally, ,^7 < 1 + 2a — 2^/0(1 + a) then the 
sequences {tk} and {xk} converge Q-quadratically and R- quadratically to t* and x^, respec- 
tively. 

We need the following results to prove the above theorem. 

Lemma 21. Let F : M" — > M™ be an analytic function. Suppose that xq G M" and 7 is 
defined in ( HOj) . Then, for all x G B{xq, I/7) it holds that 

\\F"{x)\\^{2^)/{l-^\\x~Xo\\f. 

Proof. The proof follows the same pattern as Lemma 21 from [3]. D 

Lemma 22. Let F : M" — )■ M™ be twice continuously differentiable. If there exists a 
/ : [0, i?) — )■ R twice continuously differentiable and satisfying 

\\F"{x)\\^f"{\\x-x4), 

for all X G M" such that ||x — Xo|| < R, then F and f satisfy iQ. 
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Proof. The proof follows the same pattern as Lemma 22 from [3j. D 

Proof of Theorem I20L Consider the real function / : [0, 1/7) — ?■ M defined by 

It is straightforward to show that / is analytic and that 

/(0) = 0, /'(t) = l/(l-7tf-2, /'(0) = -l, r(t) = (27)/(l-7tf, nO) = n\r~\ 

for n > 2. It follows from the last equalities that f satisfies hi and h2 in Definition [2l Now, 
as f"{t) = (27)/(l — 7t)^, combining the Lemmas |2T] and [22| we have F and / satisfy iQ 
with R = 1/7. Therefore, f is a majorant function for F on B{xo, 1/7)- Hence, 

fUt) = T^t' -t + ^ = ^ + {a-l)t + afit), 
1 — ■yt 



and, since ^7 < 1 + 2a — 2^ya{l + a), we conclude that f^^a satisfies h3 and 



2(l + a)7 
is its smallest root. In this case, the constant a satisfies 



a > 



77/3 + (1 - 77/3)(l - 7^2 vPif'iO + 1] + 1 ' 



Therefore, taking a, f^^a and t^, as defined above, all the statements of the first part of the 
theorem follow from Theorem [THl For proving the second part, it is sufficient to note that 
the assumption ^7 < 1 + 2a — 2-^a(l + a) imphes that f^^a satisfies h4. D 

4.2 Convergence result under the Robinson condition 

In this section we present a correspondent theorem to Theorem [121 namely, we assume that 
Xq satisfies the Robinson condition, see [7] and [9]. Under the Robinson condition, we also 
present results of convergence for the Lipschitz and Smale conditions. We start by defining 
the Robinson condition. 

Let C C M™" be a nonempty closed convex cone, F : MJ^ — t- M™ be a continuously 
differentiable function and x G M^. Define the multifunction T^ : M" — t- P{W^) as 

TJ = F\x)d - C. (33) 

22 



The multifunction T^ is a convex process from M" to M™. Convex process has been extensively 
studied in [lOl HI]. As usual, the domain, norm and inverse of Tj, are defined, respectively, 

by 

V{T,) := {deR'': T,d ^ 0}, ||r,.|| := suv {\\T^d\\ : x G P(T,.), |M|| < 1}, 

T-^y ■= {deW : F'{x)d ey + C}, ye M"'. 

where \\Tj;d\\ := inf{||t>|| : v G T^d}. 

The point Xq G MJ^ satisfies the Robinson condition if the multifunction T^^ carries M" 
onto M'", that is, 

\/yeW 3 d G M", 3 c G C; y = F'{xo)d - c. (34) 

Theorem 23. Lei F : M" — > M"' 6e a continuously differentiable function. Assume that 
R > 0, Xq E MJ^ and / : [0, i?) — )■ M zs a majorant function for F on B{xo,R). Take the 
constants a > and ^ > and consider the auxiliary function f^^a : [0, i?) — )■ M, 

4a(t)=e + («-l)i + a/W- 

If J f^,a satisfies h3, i.e., t* is the smallest zero of f^^a, then the sequence generated by 
Newton's Method for solving f^,a(t) = 0, with starting point to = 0, 

tk+l = tk — /^,a(4)" fi,a{tk)-, /C = 0, 1, . . . , 

is well defined, {tk} is strictly increasing, is contained in [0,t*), and converges Q-linearly 
to t*. Let rj G [l,oo), A G (0, oo] and h : M™ — )■ M 6e a real-valued convex function with 
minimizer set C nonempty. Suppose that C is a cone and xq G M" satisfies the Robinson 
condition. Let (3o = \\T~^l ///(F(xo),C) > 0, t, < rp^ := {t e[0,R) : /3o - 1 + Pof'it) < 
0}, 

then the sequence generated by Algorithm [1], denoted by {xk}, is contained in B[xQ,t^), 

F{xk) + F'{xk){xk+i -Xk) eC, /c = 0, 1, . . . , 
satisfies the inequalities 

II II ^ + + II II ^ ^^+1 ~ ^^ II l|2 

ll^^fc+l ~ ^kW ^ t^fe+l ~ t^fe) ll^^fc+l ~ Xk\\ ^ -J- 7 yjW-^k ~ ^k-lW 1 

[tk — tk-l) 

for k = 0,1, . . . , and k = 1,2, . . . , respectively, converging to a point x* G B[xq, t^] such that 
F{x,) G C, 

and the convergence is R-linear. If, additionally, f^^a satisfies h4 then the sequences {tk} 
and {xk} converge Q-quadratically and R- quadratically to t* and x^, respectively. 
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We need the following two results to prove the above theorem. 

Lemma 24. Let F : R" — )■ R"* be a continuously differentiable function and C a nonempty 
closed convex cone. Suppose that xq G R" satisfies the Robinson condition. Then 



T~H < + 



-XO 



oo. 



Moreover, if S is a linear transformation from R" to R"^ such that ||T!j,,/|| H^H < 1, then the 
convex process T, defined by T := T^^ + 5*, carries R" onto R"*, ||^^^|| < +oo and 

\\T-^\\ 

Urp-lU < II ^'0 II 



l-\\T^o'\\\\S\\' 
Proof. See Theorem 1 on p. 342 of [H]. □ 

Lemma 25. Let F : R" — )■ R™ be a continuously differentiable function and let h : R*" -^ R 
be a real-valued convex function with minimizer set C nonempty. Suppose that xq G R" 
satisfies the Robinson condition. Then Xq is a regular point of the inclusion F{x) G C, and 
in particular, xq is a quasi-regular point of the inclusion F{x) G C. Moreover, assume C is 
a cone, R > and / : [0, i?) — )■ R zs a majorant function for F on B{xo,R). Let ^ > 0, 
/So = ll^x^"*^!!; the auxiliary function f^^js^ : [0,R) -^ R, 

4/5oW:=e+(/3o-l)t + /3o/(t), 

and rp^^ := sup{t G [0,-R) : f^^j3f^{t) < 0}. If r^g is the quasi-regular radius and /3xo(") is the 
quasi-regular bound function for the quasi-regular point Xq, then 



Trr 



> r-/3o, /3xo W < -, ^,^° , ,p V t G [0, r^. 



Proof Take y G Ker{F'{xof) H (C - F(xo))°. Hence, 

= {F'ixofy, d) = {y, F'{xo)d), V rf G R^ {y, c - F{xo)) < 0, \/ceC. 

Since xq satisfies the Robinson condition, d G R" and c G C exist, such that —y — F{xo) = 
F\xo)d — c, which combining with the above inequalities gives 

(y, y) = {y,c- F{xo) - F'{xo)d) = {d,c- F(xo)) < 0. 

Soy = 0, and we obtain from Definition [3] that xq is a regular point of the inclusion F{x) G C. 
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To establish the second part, first take x E W^ such that ||a; — a;o|| < '"/3o- Using / as a 
majorant function of F on B{xq, R), as well as the definitions of /3o, /g,^o ^^"^ ^/^c ^^ obtain 

r.-i ||F'(x) - F(a:o)|| < /3o[/'(||x - a;o||) - /'(O)] = 4,„(||a: - xo||) + K 1. (35) 

Using that Xq satisfies the Robinson condition and the last inequality, it follows from 
Lemma [2l] that the convex process 

T^d = F\x)d -C = T^,d + [F'{x) - F'{xo)]d, V d G M", 

carries R" onto M™ and 

||7^-i|| p 

\\T "Ml < "^0 " < t^ rsfi^i 

"^ "-l-r-/||||F'(x)-F'(a:o)||-l-/3o[f(||x-xo||)-/'(0)]' ^ ' 

where the last inequality follows the definition of /3o and (15^ . Moreover, as T^ carries M" 
onto M™, we also have 

Dc{x) = {deR'' : F{x) + F'{x)d G C} ^ 0, V a; G B{xo, r^jj. (37) 

Now, let d G T~^(c — -F(a;)). Using the definition of T~^ it follows that 

F'{x)d ec- F{x) + C = C - F{x), 

hence we conclude that F[x) + F'{x)d G C, which combining with the definition of Dc{x) 
yields 

T-\c-Fix))cDc{x). 

Therefore, 

diO^Dcix)) < \\T-\c-Fix))\\ < ||T-^||||c-F(a;)||, \/ceC. 
The last inequality together with fl36l) imply 

40,Dc(.)) < \\T-^MF(.),C) < i_a„|;,(||,!°,„||)_;,(o/ (^W.g). 

which combined with ( 137|) . as well as definitions of ra;o and /3xo(") in dZD and ([8]), respectively, 
yields the desired inequalities. D 
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[Proof of Theorem I23| Since xq G M" satisfies the Robinson condition, we have from 
Lemma [25] that xq is a quasi-regular point of the inclusion F{x) G C with the quasi-regular 
radius r^^ > rjs^. So, taking into account the assumption t* < r^^ we obtain 

Moreover, Lemma [251 also implies that the quasi-regular bound function Pxo{-) satisfies 

"..(*)< rr^J^. Vt.|0..,J. (38) 

Since A > ^ > rif3od(F(xo), C) and the last inequality implies that /3xo(0) < (3o, we have 

A>^>r](3,Md{F{xo),C). 

Now, combining the assumptions < ^ and t* < r^^ with the first statement in Proposition [TO] 
we conclude that < ^ < t^ < r^^. So, using f[38l) . /'(O) = —1, /' as strictly increasing and 
?7 > 1; after simple algebraic manipulation we obtain 

^[/'W + i] + AT>7r + (^- i)[/'W + 1] > ^ + (^ - 1)[/'(0 + 1], V t G [e, t*), 

Pa'o If^J PO PO 



or equivalently. 



'^° > . .Jfr!'\. . , VtG[e,t.). (39) 



1 + (r/ - l)/3o[/'(0 + 1] - ^/3.o(i)[f (^) + 1] + r 
Hence, the assumption a > r7/3o/[l + (?7 — l)/3o(/'(0 + 1)] ^'^d the last inequality imply that 

a > sup < —-: — , ,r . / N ^ : t < t <t^ 

Therefore, F and Xq satisfy all assumptions in Theorem [T2] and so statements of the theorem 
follows. D 

Remark 3. Let F : W^ -^ R™ be a continuously differentiable function. Assume that 
Xo G R", -R > and K > exists, such that 

\\F\y)-F'{x)\\<K\\y-x\\, x,y G5(xo,i?). 

Note that / : [0, i?) — )■ R defined by f{t) = Kt'^/2 — t is a majorant function for the function 
F on B{xo,R)- In this case, it is easy to see that h3, h4 and t* in Theorem{2M become 



2aK^<l, 2aK^<l, t^ = {I - ^l^^2^^)/{aK), 
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and a satisfies 



a > 



In particular, if C = {0} and n = m, the Robinson condition is equivalent to the condition 
that F'{xq)~^ is non-singular. Hence, forrj = 1 we obtain the semi-local convergence for the 
Newton method under the Lipschitz condition, see lEj. 

Remark 4. Let F : R" -^ R™ be an analytic function. Assume that xq G R" and 



7 := sup 

n>l 



n! 



< +00. (40) 



Note that the real function f : [0, 1/7) — )■ R defined by f{t) = t/(l — '-ft) — 2t is a majorant 
function for the function F on B[xo, 1/7). In this case, it is easy see that h3, h4 and t^ in 
Theorem {23 become 

^7 < l + 2a-2^a{l + a), ^7 < 1 + 2a - 2^ya{l + a), 



1 + 7^- V(l + 70^-4(l + ^M 
2(l + a)7 

and a satisfies 



a > 



(r/-l)/3o + [l-/3o(r/-l)](l-70'' 
In particular, if C = {0} and n = m, the Robinson condition is equivalent to the condition 
that F'{xq)~^ is non-singular. Hence, forrj = 1 we obtain the semi-local convergence for the 
Newton method under the Smale condition, see flE/- 
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